METHOD FOR AUTOMATICALLY CORRECTING SKEW IMAGE 
BACKGROUND OF THE INVENTION 

Field of Invention 

The invention relates to a method for correcting skew images, which in particular to an 



image 



de-skew technology, acquires the precise skew angle of a scanned image. 



Related Art 

It is familiar to obtain skew images while using a copier to make a copy, or using a 
scanner to capture images from plane media, such as paper sheets. In general, it is attributed 
to a medium placed at a skew angle but not at an exact position. 

To solve this problem, the key point is how to acquire the precise skew angle. 
Generally, the characteristics of a scanned image depend on the fundamental elements in a 
document, such as characters, pictures and tables. Elements available in a document are 
usually arranged in transverse or lengthwise directions. Most of prior arts obtain the skew 
angles in accordance with the variations of elements arrangement in transverse or 
lengthwise directions. However, such methods fail to attain the accurate skew angle due to 
completely detecting through the whole medium, or every pixel in a predetermined area 
thereon. Too many variations cause serious interferences while considering all the pixels. 
Consequently, the calculating result is still an incorrect skew angle, from which another 
skew image is derived. 

SUMMARY OF THE INVENTION 

In view of the foregoing, the invention wants to solve the problems of the incorrect 
skew angle: the transverse or lengthwise variations of the fundamental elements on a plane 
medium are not achieved to an accurate skew angle for rotating the skew image to the 
normal position. 
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The above problems have been solved by providing a method for correcting skew 
images, which includes steps as follows: (a) detecting edge areas with edges on a scanned 
image; (b) calculating gradient angles of the edge areas to sum up weightings of the 
gradient angles; and (c) rotating the image according to the gradient angle with the highest 
5 weighting. 

The determination of the edge areas further comprises the following steps. 

(i) Group the image into blocks with N*N pixels. 

(ii) Group the pixels into pixel groups by various grouping angles. 

(iii) Calculate display differences between the adjacent pixel groups according to 
1 0 each of the grouping angles in the blocks. 

(iv) Confirm that the maximum display difference is larger than a threshold of the 
edge. 

(v) Define the blocks having the edges as the edge areas. 

In short, the invention achieves a skew angle with high accuracy, by first detecting all 
15 the pixels on an image through the blocks with N*N pixels, and by finding out the edge 
areas with the edges. Next, calculate the gradient angles of all the edge areas to add up the 
weightings, to attain the precise skew angle according to the gradient angle with the highest 
weighting. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention will become more fully understood from the detailed description given 
herein below illustration only, and is thus not limitative of the present invention, and 
wherein: 

FIG. 1 is a main flowchart of the method according to the invention; 
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FIG. 2 is another flowchart of the method, showing the procedure to determine the edge 
areas; 

FIG. 3 is a diagram of a block with 3*3 pixels; 

FIG. 4a is also a diagram of a block with 3*3 pixels, showing the pixel groups grouped 
5 by highlights in grouping angle 0°; 

FIG. 4b is another a diagram of a block with 3*3 pixels, showing the pixel groups 
grouped by highlights in grouping angle 45°; 

FIG. 4c is a diagram of a block with 3*3 pixels, showing the pixel groups grouped by 
highlights in grouping angle 90°; 
10 FIG. 4d is a diagram of a block with 3*3 pixels, showing the pixel groups grouped by 

highlights in grouping angle 135°; 

FIG. 5 is an explanation diagram of the Sobel Operators Gx and Gy used in the 
invention; 

FIG. 6 is a view of a skew image in a preferred embodiment according to the invention; 
1 5 FIG.7 shows display parameters in block 3 1 1 according to FIG. 6; 

FIG.8 shows an image after rotating the original skew image of FIG. 6 in the derived 
skew angle; and 

FIG.9 shows another image after cutting off the surplus boundaries of the rotated image 
in FIG. 8. 

20 DETAILED DESCRIPTION OF THE INVENTION 

The correcting method for skew images provided by the invention is for adjusting skew 
scanned images, which have fundamental elements such as characters, pictures and tables, 
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arranged originally in transverse or lengthwise directions on the plane media. In other 
words, images are suitable for using the disclosed invention if they have fundamental 
elements with the uniformity of a transverse or lengthwise arrangement. 

With reference to FIGS. 1 and 2, the method according to the invention mainly 
5 comprises the following steps. 

First, detect edge areas with edges on a scanned image (Step 110). Next, calculate 
gradient angles of the edge areas to sum up weightings of the gradient angles (Step 120). 
Eventually, rotate the image according to the gradient angle with the highest weighting 
(Step 130). 

1 0 The above steps are then further illustrated in details as follows. 

(1) Step 1 10: detect edge areas with edges on a scanned image 

The edge shows that the maximum display difference is larger than a 
predetermined threshold, wherein the display difference means a display parameter 
such as a luminance difference or a chrominance difference. The threshold is 
15 preselected from experience data in accordance with the types of image capturing 

devices, e.g. a copier or a scanner. As shown in FIG.2, the edge areas obtained in Step 
1 10 are determined by the steps of: 

A. Group the image into blocks with N*N pixels (Step 210), wherein N is an odd 
number except 1. Taking N=3 as an example, there are 9 pixels included in a block, 

20 which numbered as 1-9. Zl to Z9 represent the display parameters of all the 9 pixels 

respectively. As mentioned above, the display parameters are optionally defined as the 
luminance difference or a chrominance difference. 

B. Group the pixels into pixel groups by various grouping angles (Step 220). The 
alternatively selected grouping angles are the angles of 0°, 45°, 90° and 135° to the 

25 horizontal coordinate axis. In each of the 4 angles, various pixel groups are grouped. In 

angle of 0°, the pixel groups are grouped into group 123, group 456 and group 789 
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(shown in FIG.4a). In angle of 45°, the pixel groups are grouped into group 124, group 
357 and group 689 (shown in FIG.4b). In angle of 90°, the pixel groups are grouped 
into group 147, group 258 and group 369 (shown in FIG.4c). In angle of 135°, the 
pixel groups are grouped into group 236, group 159 and group 478 (shown in FIG.4d). 
5 C. Calculate display differences between the adjacent pixel groups according to 

each of the grouping angles in the blocks (Step 230). The term DATA down below 

represent the display parameter sum, which means the sum of the display parameters 

of all the pixels included in a pixel group. 

0°: 

10 Datal23=Zl+Z2+Z3 
Data456=Z4+Z5+Z6 
Data789=Z7+Z8+Z9 

45°: 

Datal24=Zl+Z2+Z4 
15 Data357=Z3+Z5+Z7 
Data689=Z6+Z8+Z9 

90°: 

Datal47=Zl+Z4+Z7 
Data258=Z2+Z5+Z8 
20 Data369=Z3+Z6+Z9 
135°: 

Data236=Z2+Z3+Z6 
Datal59=Zl+Z5+Z9 
Data478=Z4+Z7+Z8 
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Take Diff as the display difference, the term Diff is defined as the difference of 
the display parameter sums between any two of the adjacent pixel groups (Abs means 
absolute value), where 
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a. 0° : 

Diffl23_456=Abs (Datal23-Data456) 
Diff789_456=Abs (Data789-Data456) 

b. 45°: 

Diffl24_357=Abs (Datal24-Data357) 
Diff689_357=Abs (Data689-Data357) 

c. 90°: 

Diffl47_258=Abs (Datal47-Data258) 
Diff369_258=Abs (Data369-Data258) 

d. 135°: 

Diff478_l 59=Abs (Data478-Data 159) 
Diff478 159=Abs(Data478-Datal59) 



D. Confirm that the maximum display difference is larger than a threshold of the 
edge (Step 240). According to the definition in the foregoing, that means that there 
exists an edge in the block. In general, if the display difference is larger, the displaying 
performance will be much more obvious. If the difference is larger than a threshold 
(e.g. 120 of the luminance), or equals to the threshold, the block is classified for the 
sampling. 

E. Define the blocks having the edges as the edge areas (Step 250). The blocks 
defined as edge areas will be further processed. 

(2) Step 120: calculate gradient angles of the edge areas to sum up weightings of the 
gradient angles 

The display difference of each of the edge areas is transformed into a gradient 
angle, which represents one of the possible skew angle of the image. 

The calculation of the gradient angle is achieved through Sobel operators, Gx 
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and Gy, as shown in FIG. 5. With reference to Fig. 3, the calculating expression of 
the gradient angle A of the edge area is expressed as follows. 

Gx = (Z7 + 2*Z8 + Z9)-(Zl+2*Z2 + Z3) 
Gy = (Z3+2*Z6 + Z9)-(Zl+2*Z4 + Z7) 

A^tan'CGy/Gx) 

wherein A is the angle to the horizontal coordinate axis, and "tan 1 " is the 
inverse function of the trigonometric function, "tan". 

The gradient angle with the highest weighting is derived via adding up the 
weightings of all the calculated gradient angles. Based on the arranging uniformity 
of the fundamental elements, the gradient angle with the highest weighting is 
exactly the skew angle of the image. 

(3) Step 130: rotate the image according to the gradient angle with the highest 
weighting 

Technologies for rotating an image to a specific angle are common in the prior 
arts. The feature of the invention is precisely seeking the skew angle by adding up 
the weightings of the gradient angles. 

20 A preferred embodiment is provided for detail explanation. As shown in FIG.6, it is 

easy to recognize one of the fundamental elements on image 300 is character B. The image 
of character B is skewed in an angle. After proceeding Step 210 and 220 that attain blocks 
and pixel groups respectively, Step 230 is processing to calculate the display differences. In 
this preferred embodiment, the display difference is based on the luminance value. Taking 

25 block 311 as an example, the luminance value (the display parameter) of each pixel is 
shown as FIG. 7. Moreover, the display parameter sum of each pixel is calculated as 
follows: 
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0° : 

Datal23 =83+60+53 = 196 
Data456 =137+73+51= 261 
Data789=200+141+86 = 427 

5 45°: 

Datal24 =83+60+137 =280 
Data689 =51+141+86 = 278 
Data357 =53+73+200 = 326 
90°: 

10 Datal47 =83+137+200 = 420 
Data258 =60+73+141 = 274 
Data369 =53+51+86 = 190 
135°: 

Data478 =137+200+141 = 478 
1 5 Datal 59 =83+73+86 = 242 

Data236 =60+53+51 = 164 

The Calculation of the display differences are: 

0° : 

20 Diffl23_456 = abs (Datal 23-Data456) = abs (196-261) =65 

Diff789_456 = abs (Data789-Data456) = abs (427-2610) =166 
45°: 

Diffl24_357 = abs (Datal24-Data357) = abs (280-326) =46 
Diff689_357 = abs (Data689-Data357) = abs (278-326) =48 
25 90°: 

Diffl47_258 = abs (Datal47-Data258) = abs (420-274) =146 
Diff369_258 = abs (Data369-Data258) = abs (190-274) =84 
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135°: 

Diff478_159 = abs (Data478-Datal59) = abs (478-242) =236 
Diff236_159 = abs (Data236-Datal59) = abs (164-242) =78 

5 The result shows that the maximum display difference is 236. If the predetermined 

threshold is 120 and 236>120, block 3 1 1 can be defined as an edge area with an edge. Next, 
the gradient angle can be calculated in the following: 

Gx = (Z7 + 2*Z8 + Z9) - (Zl + 2*Z2 + Z3) 
= (200+2*141+86) - (83+2*60+53) = 312 
10 Gy = (Z3 + 2*Z6 + Z9) - (Zl + 2*Z4 + Z7) 
= (53+2*5 1+86)-(83+2* 137+200) = -316 

A=tan' l (Gy/Gx) = tan'O-Slfifltt) =-1 

Gradient angle A=-l*(180/ K )=-45° 

Repeat the procedures in the foregoing to find out all the edge areas, and calculate the 
15 gradient angles to sum up the weightings. Thus, finding an angle of -45° has the highest 
weighting. Hence, we can take -45° as the skew angle, to which the image can be rotated, as 
shown in FIG. 8. 

The skew angles obtained via the invention are usually in the range of about -89° and 
about 89°. However, a skew angle attaining near -89° or 89° maybe means that the image is 
20 purposely placed in an angle of 90°. Therefore, it is necessary to confirm that the gradient 
angles are located in a predetermined range after having them calculated. The range 
between about -89° to 89° is used in theory but optimal range of -45° to 45° is more 
practical. 

Generally, surplus boundaries of the rotated image 300 (show in FIG. 8) needs to be 
25 cut off. Thus, we provide a further step to adjust the boundaries of the rotated image. A 
final image 300 shows in FIG. 9. 
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When applying the invention on scanning devices or copiers, an extra step of 
outputting a caution message may be helpful. Such step alerts the user to operate again for 
preventing the output image from being cut incompletely during steps of adjusting the 
image boundaries, and for keeping the completeness of the image. 

5 Certain variations would be apparent to those skilled in the art, which variations are 

considered within the spirit and scope of the claimed invention. 
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